formal analysis
Reviews: Approximation and Convergence Properties of Generative Adversarial Learning
The authors present a formal analysis to characterize general adversarial learning. The analysis shows that under certain conditions on the objective function the adversarial process has a moment-matching effect. They also show results on convergence properties. The writing is quite dense and may not be accessible to most of the NIPS audience. I did not follow the full details myself.
Uses And Limitations Of AI In Chip Design
Raik Brinkmann, president and CEO of OneSpin Solutions, sat down with Semiconductor Engineering to talk about AI changes and challenges, new opportunities for using existing technology to improve AI, and vice versa. What follows are excerpts of that conversation. Brinkmann: There are a couple of big changes underway. One involves AI in functional safety, where you use context to prove the system is doing something good and that it's not going to fail. Basically, it's making sure that the data you use for training represents the scenarios you need to worry about. When you have many vectors of input it's difficult to cover all the relevant cases.
FANNet: Formal Analysis of Noise Tolerance, Training Bias and Input Sensitivity in Neural Networks
Naseer, Mahum, Minhas, Mishal Fatima, Khalid, Faiq, Hanif, Muhammad Abdullah, Hasan, Osman, Shafique, Muhammad
With a constant improvement in the network architectures and training methodologies, Neural Networks (NNs) are increasingly being deployed in real-world Machine Learning systems. However, despite their impressive performance on "known inputs", these NNs can fail absurdly on the "unseen inputs", especially if these real-time inputs deviate from the training dataset distributions, or contain certain types of input noise. This indicates the low noise tolerance of NNs, which is a major reason for the recent increase of adversarial attacks. This is a serious concern, particularly for safety-critical applications, where inaccurate results lead to dire consequences. We propose a novel methodology that leverages model checking for the Formal Analysis of Neural Network (FANNet) under different input noise ranges. Our methodology allows us to rigorously analyze the noise tolerance of NNs, their input node sensitivity, and the effects of training bias on their performance, e.g., in terms of classification accuracy. For evaluation, we use a feed-forward fully-connected NN architecture trained for the Leukemia classification. Our experimental results show $\pm 11\%$ noise tolerance for the given trained network, identify the most sensitive input nodes, and confirm the biasness of the available training dataset.
A Formal Analysis of Required Cooperation in Multi-Agent Planning
Zhang, Yu (Arizona State University) | Sreedharan, Sarath (Arizona State University) | Kambhampati, Subbarao (Arizona State University)
It is well understood that,through cooperation, multiple agents can achieve tasks that are unachievable by a single agent.However, there are no formal characterizations of situations where cooperation is required to achieve a goal, thus warranting the application of multiple agents. In this paper, we provide such a formal characterization for multi-agent planning problems with sequential action execution. We first show that determining whether there is required cooperation (RC) is in general intractable even in this limited setting. As a result, we start our analysis with a subset of more restrictive problems where agents are homogeneous.For such problems, we identify two conditions that can cause RC. We establish that when none of these conditions hold, the problem is single-agent solvable;otherwise, we provide upper bounds on the minimum number of agents required. For the remaining problems with heterogeneous agents, we further divide them into two subsets.For one of the subsets,we propose the concept of {\em transformer agent} to reduce the number of agents to be considered which is used to improve planning performance.We implemented a planner using our theoretical results and compared it with one of the best IPC CoDMAP planners in the centralized track.Results show that our planner provides significantly improved performance on IPC CoDMAP domains.
The Ninth International Conference on Machine Learning
The Ninth International Conference on Machine Learning was held in Aberdeen, Scotland, from 1-3 July 1992, with 198 participants in attendance. The conference covered a broad range of topics drawn from the general area of machine learning, including concept-learning algorithms, clustering, speedup learning, formal analysis of learning systems, neural networks, genetic algorithms, and applications of machine learning. This article briefly touches on six selected talks that were of exceptional interest.